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EXECUTIVE  SUMMARY 

The  joint  variation  of  effectiveness  and  diffraction  efficiency  in 
computer  designed  pattern  recognition  filters  was  studied.  Conclusions  of 
this  study  include: 

o  The  recognition  of  the  need  to  eliminate  spurious  detail  from  real 
images  before  using  those  images  to  form  recognition  masks, 

o  The  demonstration  that  fine  (10°)  angular  sampling  is  not  strictly 
necessary  (20°  sampling  allowed  recognition  of  intermediate  angles 
but,  of  course,  with  diminished  certainty), 

o  The  demonstration  that  all  available  data  can  be  included  in  a 

generalized  matched  filter.  (The  more  images  included  the  better 
the  response  to  intermediate  or  test  cases  but  the  lesser  the 
response  to  the  training  images.  Since  response  to  the  training 
images  is  much  better  than  needed,  the  tradeoff  is  favorable),  and 

o  Devising  a  new  approach  to  design  of  phase  only  GMF's  which  puts 
increased  emphasis  on  phase  (as  opposed  to  amplitude)  information. 

Also  included  in  this  report  is  a  brief  discussion  of  complexity  theory 
and  how  it  might  apply  to  optical  computing  efforts  in  the  U.S.  and  elsewhere. 
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INTRODUCTION 


In  December  1983  Aerodyne  Research,  Inc.  (ARI)  began  work  towards 
improving  an  improved  algorithm  for  modeling  rotation  tolerant  spatial 
frequency  filters  proposed  for  use  in  optical  pattern  recognition  devices. 

This  work  was  to  be  supported  by  RADC/ES  for  18  months  at  a  level  of  about 
$150  K.  The  contract  was  amended  by  MIPR  in  “December  1984.  The  new 
contract  required  additional  research  in  the  area  of  complexity  theory  and  the 
additional  funding  was  “$30  K.  The  deliverable  is  this  Final  Report  of 
Progress. 
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1.  INTRODUCTION  TO  PATTERN  RECOGNITION  PRINCIPLES 


The  art  and  science  of  optical  matched  spatial  filtering  has  evolved 
considerably  since  its  introduction  by  VanderLugt.1  Drawbacks  of  matched 
filtering  such  as  Intolerance  to  scale  changes  and  rotation  of  the  class  to  be 
matched  with  respect  to  the  matched  filter  (MF)  have  been  addressed  in  many 
articles.  Here  the  tradeoffs  of  within-class  insensitivity  vs.  be  tween-class 
sensitivity  are  well  Illustrated.  Caulfield  et  al2  surveyed  progress  in  MF 
improvements.  *  The  most  recent  contributions  to  the  field  of  optical  pattern 
recognition  have  been  in  appropriate  definition  of  diffraction  efficiency  (DE) 
and  suggesting  methods  for  its  Improvement.  Horner  was  the  first  to  define  a 
meaningful  measure  of  the  MF  DE.3  A  study  of  filter  discrimination  vs.  filter 
DE  seems  called  for. 

1 . 1  Fundamentals 

A  brief  encapsulation  of  the  concept  of  space  invariant  matched  filtering 
for  pattern  recognition  follows: 

The  amplitude  distribution  in  the  correlation  plane  is  described  as 

♦  (x**,y”)  -  //  f(x’,y')  g*(x'-x" ,  y'-y")  dx’  dy'  (1) 

which  is  the  correlation  of  an  input  spatial  function,  f(x,y)  with  a  reference 
function  g(x,y).  That  is,  g(x,y)  is  the  pattern  to  be  recognized.  The 


♦Strictly  speaking,  a  matched  filter  is  a  very  particular  thing  which  cannot 
be  "improved”  because  anything  else  is  not  a  matched  filter.  Unfortunately 
popular  usage,  to  which  we  hereby  capitulate,  is  to  call  all  pattern 
recognition  filters  matched  filters.  The  Inaccuracy  of  this  usage  is 
compensated  for  by  convenience. 


correlation  can  be  accomplished  with  a  multiplication  of  F(x* ,  y* )  and 
G*(x',y'),  where 


F(x' y 1 )  [  f(x,y)  ]  «  //  f(xty)  ik/£^xx  +  yy  ^  dx  dy  ,  (2) 

and  likewise  for  G(x* ,y*).  A  superscript  *  indicates  complex  conjugate,  i.e., 

G*  (x'  ,y’)  *  //  g*(x,y)  e^ik//i^xx  +  ^  ^  dx  dy  .  (3) 

Equation  (1)  can  also  be  expressed  as 

♦  (x”,y#*)  *  f(*,y)  *  g(x,y)  (*) 

where  *  indicates  correlation. 

[.]  is  the  Fourier  transform  operator,  k  is  2ir/A,  the  optical  wave 
vector  of  wavelength  A.  The  coordinates  [x,y]  and  [x* fyf]  are  specified  in 
the  front  and  back  focal  planes  of  the  lens  of  focal  length  l  used  to  form  the 
transform* 

In  optical  matched  filtering  systems,  G*(x'y')  is  recorded 
holographically  after  VanderLugt.1  The  filtering  operation  [Eq.  (1)]  can  be 
regarded  as  detection  in  the  focal  plane  of  the  reconstruction  of  the 
reference  plane  wave  used  to  create  the  holographic  filter.  Therefore,  what 
is  observed  is 


I(xH,yM)  -  *<xM,y")  **(x’\y")  -  |f(x,y)  *  g(x,y)|‘ 


(5) 


Most  improvements  on  VanderLugt’s  filter  are  attempts  at  improving  their 
discrimina tion  capabilities  by  increasing  the  signal- to-noise  ratio  in  the 
ixM,yM]  plane.  One  of  these  is  phase  only  matched  filtering,  reported  by 
Horner  and  Gianino.** 
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2.  GENERALIZED  MATCHED  FILTER  METHOD 


The  intent  in  creating  a  generalized  matched  filter2"3  is  to  maximize 
within  class  tolerance  of  a  pattern  recognition  system  for  recognizing  any 
given  pattern  to  the  exclusion  of  any  others.  Therefore,  besides  its 
excellent  discrimination  properties,  the  GMF  is  characterized  by  its  generic 
nature,  that  is,  choice  of  classes  to  be  separated  is  arbitrary.  In  this 
case,  the  MF  is  much  less  versatile  than  the  GMF  and  Is,  in  fact  a  GMF  special 
case.  We  realize  the  GMF  with  a  set  of  computer  images  of  variations  of  a 
spatial  reference  function  gi(x,y)  by  expressing  each  of  its  points  as  a 
discriminator  derived  from  the  mean  and  variance  from  the  mean  of  the 
respective  point  In  each  of  a  chosen  subset  of  gi(x,y). 

We  start  by  computing  the  Fast  Fourier  Transform  (FFT)  at  each  point  In 
each  gi(x,y).  The  sets  (Gi/x'y1)}  is  the  resulting  collection  from  our  i 
given  variations  of  gi(x,y)  data.  Gj^x* ,y')  is  an  MN  component  vector 
representing  the  FFT  of  the  i*h  g(x,y)  MxN  matrix. 

Now  we  choose  appropriate  samples  to  be  representative  of  S  in  the  GMF. 

In  our  case,  we  were  given  eleven  computer  images  representing  each  of  11 
angles  to  a  stationary  viewer  of  real  infrared  tank  data.  We  chose  six  of 
these  Images. 

The  means  and  variances  of  each  of  G*  are  computed  point  by  point, 
collected  and  then  reformatted  into  a  matrix  which  we  will  call  S^y  (means 
and  variances).  Now  a  statistical  discriminator  function  is  applied  to  each 
row  of  Smv •  In  our  case  SMV  is  a  256  x  256  real  matrix  and  a  256  x  256 
imaginary  matrix  consistent  with  our  complex  S  {Gi(x,,y,)J  tank  picture  FFT 
vector  set. 
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This  discriminator  separates  into  two  sets  which  are  collections  of 

colored  noise  and  tank  data  points*  S^v  *  $CN  +  St*  Now  that  the  set 
Smv  Is  optimally  separated,  we  can  express  it  as 

sw  • 1  (x'’y,)  • G  (x‘»y‘)  »  (6) 

with  C  (x# ,y')  the  vector  format  of  the  GMF  matrix. 

In  traditional  statistical  pattern  recognition  terms,  C  (x'y1)  is 
considered  the  vector  which  will  maximize  the  ratio  of  the  between  to  within 
class  scatter  matrices*  The  equation 


[B  -  AW]  C  -  0  (7) 

yields  X,  the  maximum  eigenvalue  of  the  eigenvector  X  which  defines  C,  the 
elements  of  the  GMF*  B  and  U  are  the  Between  and  Within  class  scatter 
matrices,  respectively*  The  classes,  of  course,  are  tanks  and  noise. 
Caulfield  and  Weinberg  describe  the  elements  of  B  and  W  In  Ref*  3. 
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3.  PATTERN  RECOGNITION  FILTER  EFFICIENCY 


Researchers  have  shown4 that  removal  of  amplitude  yields 
"improved”  discrimination  in  matched  filters.  In  fact,  much  attention  has 
been  paid  recently  to  improving  pattern  recognition  system  efficiency  by  means 
similar  to  the  removal  of  amplitude  in  the  pattern  recognition  filter.  For 
Instance,  Lohmann  and  Thum6  suggest  introduction  of  a  periodic  phase  mask 
immediately  behind  the  input  object  making  the  Fourier  spectrum  of  the  masked 
object  more  constant  in  amplitude  than  the  Fourier  spectrum  of  the  object 
itself.  Lohmann  and  Thum  show  that  a  constant  amplitude  photographic  filler 
made  with  an  object  and  mask  yields  high  autocorrelation  intensity.  This 
insight  supports  our  choice  of  the  constant  maximum  amplitude  phase  only 
filter  for  increased  pattern  recognition  efficiency. 

Bartelt7  adds  further  support  for  phase-only  matched  filtering  methods  by 
suggesting  that  the  object  amplitude  can  be  represented  in  the  Fourier  filter 
plane  with  proper  choice  of  a  phase-only  kinoform  K(x'y*)  in  the  input. 
Efficiencies  approaching  unity  can  then  be  achieved  with  introduction  of 
another  phase  only  kinoform  ^(x'y')  as  a  filter.  This  combination  of  a  lens 
sandwiched  between  kinoforras  is  called  a  tandem  component  (TC)  and  can  yield  a 
variety  of  outputs  depending  upon  the  point  spread  function  derived  from  the 
TC*s  combination  with  particular  external  configurations.  For  instance,  for 
Bartelt's  configuration  of  a  phase  mask  (in  effect  Lohmann's  system  with  a 
phase  only  matched  filter),  the  point  spread  function  in  one  dimension  is: 

h(x"  -  x«;  x* )  -  Kx(x')  •  K2(x”  -  x* )  ,  (8) 

while  the  point  spread  function  for  the  GMF  is  the  familiar 

h(x"  -  x*;  x1)  -  [ 6 (x”  -  x)]  .  (9) 
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The  impulse  response  (point  spread  function)  of  Eq.  (9)  transforms  x'  to  a 
point  x"  dependent  upon  its  difference  from  x*  (space  invariant)  whereas  the 
impulse  response  of  Eq,  (8)  explicitly  transforms  x*  to  xM  (space  variant). 
Space  variance  is  a  property  of  all  TC  configurations.  The  GMF  accomplishes 
space  invariant  pattern  recognition  filtering. 
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4.  GMF  EFFICIENCY 


We  will 

nH 


use 


'M 


Horner's  measure  to  characterize  GMF  efficiency 

U_  lf(xty)  *  g(x,y)|2  dx  dy 
//  |f(x,y)  2  dx  dy 


(10) 


where  is  the  maximum  diffraction  efficiency  of  the  medium.  The  GMF, 
C(x* ,y*),  is  created  in  the  Fourier  plane  and  possesses  efficiency 


// 

F(x'y') 

»  C*(x', 

»y') 

^  dx  dy 

If 

f(x,y) 

^  dx  dy 

(ID 


It  is  apparent  that  the  transmittance  of  C*(x* ,y*)  is  the  efficiency 
determining  measure.  Furthermore,  for  hm  *  1#  a  conceivable  value, 
will  equal  1  if  all  amplitude  information  in  C(x* ,y')  is  removed.  This  is,  in 
fact,  the  phase  only  filter  where  each 


C(x'y’) 


(12) 


is  divided  by  its  respective  amplitude,  Ajk  and  possesses  unity  efficiency, 
is  the  phase  term  of  the  x  j  ,  yk  GMF  component. 

In  practice,  such  as  in  our  experimental  data  analysis,  dh  "ill  not 
reach  unity  since  the  integration  in  its  numerator  must  be  restricted  to 
coordinates  of  or  immediately  surrounding  the  correlation  peak. 
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5.  EXPERIMENTS 


According  to  the  contract  objective,  design  of  experiments  was  meant  to 
yield  data  describing  the  merits  of  the  GMF  and  the  phase-only  GMF.  All 
results  were  obtained  using  Aerodyne  Research,  Inc.  (ARI's)  PRIME  600. 

Programs  for  carrying  out  all  data  manipulations  are  available.  Our 
experimental  process  consisted  of  the  following  five  steps: 

1.  Preliminary  tests  with  rotated  squares, 

2.  Background  removal  and  centering  of  supplied  tank  Images, 

3.  Reduction  of  tank  images  to  pure  shape  and  GMF  creation, 

4.  GMF  tailoring  and  collecting  data  thereof,  and 

5.  Data  analysis. 

5.1  Preliminary  Tests 

5.1.1  Generating  the  Rotated  Squares 

Computer  rotation  of  squares  proved  far  more  difficult  and  perplexing 
than  we  had  anticipated.  We  used  Aerodyne1 s  rotation  algorithm  in  which  each 
individual  object  point  is  rotated  and  the  value  of  what  point  is  shared  among 
the  four  bounding  points  on  the  final  grid  as  shown  below: 


t  1,  2,  3,  4  desired 
sampling  grid  points 


object  point  found  by 
**  rotation 


d} ,  d2 ,  d3 ,  d4  distances 


Figure  1. 
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If  the  point  has  a  value  S,  we  assign  a  value 


St  -  (S/d^J/n  (13) 

where 

*  (14) 

<*4 

There  is  no  magic  to  the  d* .  We  could  have  used  d  to  any  other  power.  Note 
that 

S1  +  S2  +  S3  +  S4  "  S  (15) 

and  that  a  uniform  image  is  kept  uniform  by  such  an  operation.  The  edges, 
however,  present  a  problem.  Figure  2  shows  a  -10°  rotated  square.  This  is  a 
black  and  white  copy  of  a  pseudo  colored  display.  It  shows,  as  expected,  that 
the  edges  of  a  rotated  square  are  not  sharp.  When  we  recognize  such  a  rotated 
square,  what  are  we  really  recognizing:  the  inherent  structure  of  rotated 
squares  or  the  accidental  structure  introduced  by  our  (or  any  other)  rotation 
algorithm?  We  note  in  Figure  2  that  the  edge  structure  looks  highly  regular. 
Accordingly,  we  suspect  it  would  be  easy  to  recognize.  If  we  construct  a  GMF 
from  11  rotated  squares,  complex  conjugate  it,  and  inverse  Fourier  transform 
it  we  arrive  at  the  figure  (real  not  nonnegative  like  the  square)  to  which  the 
GMF  is  matched*  Figure  3  plots  the  amplitude  of  this  "pseudo  square."  It  is 
easy  to  see  that 

o  Only  high  spatial  frequencies  (edges)  count, 

o  The  corners  are  especially  "interesting"  to  the  GMF,  and 

o  Something  having  absolutely  nothing  to  do  with  rotated  squares  is 
being  recognized. 
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es 


Clearly  this  "something  extra”  is  the  artifact  mentioned  earlier. 

Having  demonstrated  the  problem,  we  sought  solutions.  Unhappily  the 
basic  problem  seems  quite  fundamental.  Rotating  a  sampled  Image  and  then 
"resampling”  in  the  original  unrotated  coordinate  systems  leads  to  Inevitable 
edge  artifacts.  Accordingly,  we  sought  to  "smooth  out"  those  artifacts  by 
convolving  the  rotated  and  resampled  object  with  a  blur  function.  Let  the 
rotated  and  resampled  object  be 


and  the  blur  function  be 


b  ( 


*1'  V 


Then  the  first-order  smoothed  object  will  be 


°(1)  <v  V  ’  J  b  (v  V  0  (xt  *  v  yj  •  V 


(16) 


Denoting  Fourier  transforms  by  capitals  and  omitting  the  variables  conjugate 
to  x  and  y  for  convenience,  we  can  see  that 

0(1)  «  BO  .  (17) 

To  avoid  polarity  changes  in  o(xi,  yj),  we  must  make  B  uniphase.  One 
function  which  does  tills  Is  a  triangular  function.  In  a  single  continuous 
variable  a  triangle  function  like  in  Figure  4 
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Figure  4. 


has  a  sine2 ( • )  Fourier  transform  which  Is,  of  course,  uniphase  (positive).  Ue 
used  the  simplest  triangle  for  b(x),  l.e. 


Figure  5. 

In  two  dimensions, 

1/2  0 

1  1/2  .  (18) 

1/2  0 

Convolving  again,  we  have 

0(2)  «  0^  *  b  -  0  *  (b  *  b)  (19) 

which  represents  a  further  blurring.  Figures  6  and  7  show  singly  and  doubly 
blurred  **10*  squares  displayed  as  before.  Some  of  the  regularity  Is  blurred. 
The  '’pseudo  square"  corresponding  to  a  single  blurring  Is  shown  In  Figure  8. 
Clearly  the  "extra”  Information  has  been  removed  or  at  least  greatly  reduced. 


5.2  Background  Removal  and  Centering 


The  tank  Imagery  we  received  contained  tank  outlines  with  an  overlay  of 
random  pixel  values  corresponding  to  noise  In  the  background  as  well  as  In  the 
Imaging  apparatus  and  the  Illumination  conditions.  In  addition,  the  tank 
outlines  were  displaced  from  the  center  of  their  respective  frames.  In 
creating  the  GMF,  and  in  using  it  for  correlations,  centered  Images  with  clear 
backgrounds  are  desirable  In  order  that  1)  Coordinates  of  correlation  peaks 
can  be  positively  Identified  and  2)  Background  random  noise  spectra  are 
excluded  from  those  of  the  tank.  Therefore,  we  designed  a  program  which 
allowed  us  to  outline  the  tank  by  hand  with  a  cursor  and  joystick  and  to  place 
the  geometric  center  of  the  resulting  tank  outline  at  the  center  of  the  frame. 

5.3  Reduction  of  Images  to  Binary 

What  remained  after  the  previous  step  were  the  outlines  of  tanks  with 
overlays  of  nearly  Indlscernable  structure  mixed  with  random  scatter 
representing  the  particular  (unknown)  Illumination.  A  GMF  was  created  using 
six  of  these  eleven  images.  Correlations  with  Images  less  background  in  both 
the  six  used  and  the  five  not  used  sets  were  generated.  Scans  of  the  row  and 
column  containing  the  greatest  correlation  plane  amplitude  were  used  in  the 
analysis.  In  this  case,  we  saw  no  correlation.  Therefore,  since  the  Intent 
is  to  correlate  shape,  and  not  scattered  light  content  within  the  shape,  we 
created  an  Improved  GMF  after  setting  all  amplitudes  with  the  Images  of  the 
Incorporated  tanks  equal  to  1,  retaining,  as  before,  zero  background.  This 
GMF,  upon  correlation  with  the  tanks  with  scattered  light,  both  within  and 
outside  of  the  Incorporated  set  yielded  positive  results. 

The  theoretical  validity  of  this  approximation  was  proven  by  Horner  for 
one  dimension  In  a  private  communication  as  follows: 

Let  Input  -  f(x) 

Noisy  input  -  f(x)  +  n(x) 

"Clean"  filter  -  h(x)  -  f(x-Xo) 

"Dirty"  filter  ■  h*  (x)  -  f(x-Xo)  +  n(x) 
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Case  1:  Correlation  with  "clean"  filter 


R  »  f(x)  *  h(x)  -  [ f(x)  +  n(x)l  *  f(x-x  )  *  R(x-x  )  +  n(x)  *  f(x-x  ) 

0  0  o 

(20) 

Case  11:  Correlation  with  "dirty”  filter 

R  »  f(x)  *  h’ (x)  ■  [ f(x)  +  n(x)]  *  (f(x-XQ)  +  n(x) ]  (21) 

*  R(x-x  )  +  n(x)  *  f(x-x  )  +  n(x)  *  f(x)  +  n(x)  *  n(x)  (22) 

o  o 

If  n(x)  Is  white,  the  third  term  clearly  can  be  neglected.  Otherwise  the 
difference  between  Case  I  and  Case  XI  depends  upon  the  degree  to  which  f(x) 
looks  like  noise.  If  this  degree  is  significant,  both  Case  I  and  Case  II  are 
severely  limited.  Of  course,  the  fourth  term  by  the  random  nature  of  n(x), 
goes  to  zero.  Therefore,  the  validity  of  binarizing  our  training  set  inputs 
is  summarily  proven. 

5.4  GMF  Tailoring 

Next  we  proceed  to  progressively  bias  the  GMF  towards  a  record  of  phase 
only  information.  This  is  accomplished  most  dramatically  by  progressively 
removing  edge  pixels.  This  is  because  the  GMF,  unlike  Matched  Filter, 
transmits  more  light  at  its  edges  (high  spatial  frequency  correlation)  than  in 
its  center.  The  0,  it  phase  structure  is  evenly  distributed,  however,  and, 
thus,  the  progression  toward  a  phase-only  case  can  be  shown. 

To  achieve  the  maximum  Horner  efficiency,  we  set  the  highest  transmission 
(generally  near  the  highest  spatial  frequency)  to  unity.  Thus  we  vary  the 
efficiency  by  1)  varying  the  maximum  spatial  frequency  and  2)  renormalizing 
for  each  spatial  frequency.  Naturally,  lower  maximum  spatial  frequencies  have 
higher  Horner  efficiencies  because  all  objects  have  (on  the  whole)  more  low 
frequency  than  high  frequency  power. 
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The  implementation  of  this  technique  is  as  follows: 

o  Normalize  256  x  256  GMF  to  its  highest  amplitude  (transmission) 

o  Observe  correlation  with  input 

o  Remove  all  but  center  128  x  128  pixels 
o  Renormalize 

o  Observe  correlation 

o  Remove  all  but  center  64  x  64  pixels 

o  Renormalize 

o  Observe  correlation 

o  Remove  all  amplitude  by  dividing  each  one  by  itself 

o  Observe  correlation 

We  observed  the  correlations  by  scanning  across  the  row  and  column  of  the 

maximum  output  signal. 

This  manipulation  of  filter  spatial  frequencies  should  yield  the 
relationship  between  GMF  discriminating  ability  and  efficiency  as  the  GMF  is 
progressively  low  frequency  biased. 

5.4.1  Statistical  Analysis 

Table  1  contains  three  measures  of  a  filter's  merit.  All  data  was 
extracted  from  row  and  column  traces  through  the  maximum  value  pixel  in  the 
computer  simulated  correlation  of  the  GMF  with  each  of  five  input  angle 
variations,  all  out  of  the  training  set  which  formed  the  GMF.  All  of  these 
measures  will  be  defined  below. 


Table  1  -  Three  Figures  of  Merit  of  the  GMF 


Format 

F 

Clustering  Coefficient 

Relative 

Phase  Only 
(256  x  256) 

2.9 

12 

i 

64  x  64 

2.66 

13.2 

3.1  x  10-4 

128  x  128 

1.56 

33.8 

1.2  x  10"s 

256  x  256 

1.9 

45.4 

9.0  x  10"5 
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The  Fisher  Criterion,  F 


Ay  -  Ay 


2  Av  t1 1  ”  Ijl(I  ,1  eS  )  *  2  Av  t1!  ■  ‘jld  ,I.eS  ) 
i  j  T  i  J  N 

(23) 

represents  rotation  tolerance  as  the  ratio  of  the  determinants  of  the  Between 
(B)  to  Within  (W)  class  scatter  matrices  for: 


St  ■  set  of  all  inputs  corresponding  the  class  of  tanks 

Sn  ■  set  of  all  Inputs  not  corresponding  to  tanks 

I*  *  detected  signal  when  the  ith  input  pattern  li  is  presented. 

The  class  Sr  is  represented  by  the  second  largest  magnitude  in  any  of 
the  ten  (five  row,  five  column)  traces  through  the  five  correlations.  Thus, 
noise  is  biased  high  with  an  average  value  figured  from  among  the  largest 
noise  responses.  Subjec tively,  this  noise  spike  is  typical  of  the  signal 
which  will  most  likely  trigger  a  false  correlation  response. 

The  Clustering  Coefficient  represents  rotation  tolerance  of  the  GMF  but 
is  also  an  indicator  of  confidence  level  in  other  figures  of  merit.  The 
coefficient  was  calculated  by  averaging  the  magnitudes  of  the  distances  of  the 
output  maxima  from  the  center  output  pixel.  Therefore,  since  in  space 
invariant  filtering  systems,  the  correlation  peak  is  in  theory  at  the  center 
of  the  output  plane  for  an  input  on  axis,  the  clustering  coefficient 
represents  filtering  system  error.  It  is  significant  that  in  the  phase-only 
and  64  x  64  case  the  similar  average  clustering  coefficient  was  calculated 
from  even  more  similar  correlation  peak  placements.  Presumably,  the  errors 
are  predictable  and  are  unique  to  the  input  rotation  angle.  Since  these 
errors  are  predictable,  they  are  correctable,  and  additional  manipulation  of 
the  data  has  lead  to  this  Improvement. 

The  Horner  efficiency,  is  described  in  detail  in  a  previous 
section.  It  is  presented  in  Table  1  as  the  average  of  the  largest  correlation 
pixel  intensities  for  non- training  set  Inputs,  normalized  to  the  case  of  the 
phase  only  GMF  format.  Actual  n H  WH1  be  quite  different  because  each  peak 
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correlation  intensity  will  be  normalized  to  the  integrated  input  f(x,y) 
intensity.  Normalization  to  the  phase-only  case  is  for  demonstration  of  its 
virtue,  in  particular.  As  a  matter  of  interest,  our  largest  observed  n 

H 

(for  inputs  within  the  training  set)  is  approximately  one  order  of  magnitude 
greater  than  the  average  over  non-training  set  cases  presented. 

This  data  represents  our  progress  to  October  84.  Since  then  we  have 
drawn  other  conclusions  based  on  further  data.  In  particular,  it  is  necessary 
to  characterize  the  Generalized  Matched  Filter  and  its  Phase  only  counterpart 
in  terms  of  three  system  parameters:  Signal- to-Noise  Ratio  (SNR),  Efficiency 
(nn)>  and  False  Alarm  Figure.  To  obtain  this  data,  it  is  of  primary 
importance  to  positively  identify  the  correlation  peak.  The  following 
discussion  targets  this  issue. 

5.4.2  Clustering  Coefficient 

The  preliminary  data  above  consists  of  row  and  column  traces  in  the 
output  plane  through  the  maximum  value  pixel.  We  based  our  figure  of  merit 
data  on  these  intensity  values.  The  clustering  coefficient  was  also  presented 
as  a  level  of  credibility  of  the  other  figures  of  merit,  F,  and  oh*  The 
clustering  coefficient  is  the  average  distance  of  the  observed  maximum 
correlation  intensity  for  inputs  out  of  the  training  set  from  the  center  pixel 
in  the  output  plane  for  each  filter  format.  We  have  found,  however,  that  to 
expect  the  correlation  maxima  to  occur  at  the  center  pixel  is  not  valid.  This 
we  know  since  training  set  maxima,  which  are  very  sharply  peaked  occur  at  near 
center  pixels.  I t  is  intuitively  clear  that  the  centering  of  individual 
elements  of  the  composite  FFT^1  {GMF}  (impulse  response)  will  not  be  pert*ct 
and,  therefore,  the  cross  correlations  of  this  impulse  response  and 
non-training  set  Inputs  will  be  even  less  perfect. 

A  possible  explanation  for  this  fact  is  that  the  centering  information 
(moments)  of  the  training  set  members  is  calculated  using  the  Internal  pixels 
oi  the  tank  Image  while  the  composite  filter  retransforms  only  training  set 
member  edges.  These  edges  distinctly  appear  in  the  re  transforms tion  of  the 
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GMFt  and  their  centering  will  not  in  general  be  the  same  as  that  of  the 
mass-centered  input. 

Now  that  we  have  the  virtual  centers,  we  can  look  there  for  the 
correlation  peak  and  use  an  average  clustering  coefficient  to  define  a  small 
area  around  the  virtual  center  wherein  the  peak  should  be  found.  If  this  peak 
is  not  sufficiently  distinct  from  noise,  or  if  greater  valued  peaks  exist 
elsewhere,  then  the  filter  must  be  suspect.  Our  SNR  and  nn  figures  will  be 
based  on  the  greatest  valued  pixel  in  the  area  of  the  virtual  center.  Peaks 
of  greater  magnitude  will  be  tabulated  as  false  alarms.  The  average 
clustering  coefficient  is  about  five  pixels.  This  defines  one  half  of  a 
square  dimension  to  be  drawn  about  the  virtual  center  and  probed  for  a 
maximum. 

False  Alarm  Figure 

The  false  alarm  figure  is  the  number  of  pixel  values  outside  of  the  above 
described  area  surrounding  the  virtual  center  which  have  equal  or  greater 
value. 

Signal  To  Noise  Ratio  (SNR) 

The  signal  is  determined  by  the  maximum  pixel  value  in  an  area  within 
five  pixels  (-  radius)  of  the  virtual  center.  The  noise  is  the  sum  of  all 
output  values  outside  of  the  first  minimum  in  the  signal  envelope.  This 
envelope  typically  comprises  a  radius  of  three  of  four  pixels. 

Horner  Efficiency 

nil  is  determined  as  the  ratio  of  the  signal  defined  above  to  the  summed 
pixel  values  in  the  input. 

5.5  Latest  Data  and  Analysis 

These  data  are  presented  in  Table  2. 
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Table  2 


False  Alarm  (//) 

SNR 

n  H(Z) 

Ae1*  256 

115 

5 

1.4  x  10“5 

128 

67 

4.1 

1.9  x  10~3 

64 

124 

4.5 

1.7  x  10-1* 

e1*  256 

57 

4.2 

3.4  x  10_1 

128 

208 

3.4 

3.9  x  10"2 

64 

325 

3.4 

3.9  x  10~2 

Latest  data  based  on  virtual  center  -  derived  maximum  correlation  signal 
intensities.  Ae*$  -  amplitude  and  phase  GMF;  e*$  -  phase  only  GMF. 

Indicated  values  are  averages  over  the  three  orientations  of  input  tanks  10°, 
50°,  90°. 

The  following  remarks  are  to  help  clarify  the  data. 

1)  First,  tank  images  of  only  three  orientation  angles  outside  of  the 
training  set  were  available  for  these  experiments.  These  orientations  are 
10°,  50°,  and  90°  angle  to  the  viewer  of  the  longitudinal  axis  (along  gun 
barrel)  of  the  tank.  Our  feeling  is  that  the  10°  image  carries  the  least  and 
90°  the  greatest  amount  of  tank-specific  information.  Indeed,  the  data 
support  this  intuition. 

2)  Second,  filters  of  various  spatial  extent  were  tested  in  both  the 
phase-only  and  amplitude  and  phase  cases.  Ue  would  expect  little  deviation  in 
the  data  between  different  size  phase-only  filters  and  marked  differences 
between  various  sized  amplitude  and  phase  filters.  This  is  because,  in  a  GMF, 
amplitude  transmittance  is  greatest  at  the  edges  whereas  phase  values  are 
distributed  evenly.  The  data  presented  here  is  by  this  test  inconclusive 
except  for  our  hh  data  which  are  more  alike  for  eM  chan  for  Ae1* 

filters. 
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There  is,  however,  a  trend  among  all  the  Ae*^  data  which  is  not  present 
in  the  data.  Performance  is  best  across  the  board  for  smaller  (64  x  64) 
filters,  dips  and  then  improves  again  to  a  lesser  degree  for  large  (256  x  256) 
filters.  We  observed  this  same  trend  in  our  pre-October  data  (Table  1). 

What  is  apparent  from  the  data  in  Table  2  is  that  the  efficiency  of 
phase-only  filters  is  superior.  It  is  also  apparent  that  SNR  is  adequate, 
but  the  shortcoming  of  the  GMF  seems  to  be  in  its  false  alarm  figure.  This  is 
clearly  gross  sub-spec  performance.  The  interesting  note  about  the  false 
alarm  figure  is  that  for  the  90°  orientation,  it  is  much  lower  than  average, 
ranging  from  zero  to  three  for  both  Ae1^  and  ei(>.  This  suggests  an  input 
dependent  and  not  algorithm-dependent  problem  and  therefore,  the  GMF  concept 
should  not  yet  be  questioned.  A  solution  may  be  a  weighing  of  training  set 
orientations  which  are  "hard  to  recognize"  i.e.,  tanks  pointed  at  the 
observer.  In  addition,  centering  training  set  entrants  by  their  outlines  may 
clear  up  the  problem  of  scattered  peaks,  (see  Figure  9)  thus  ensuring  the 
right  choice  in  the  correlation  plane.  In  general,  improvement  in  the  false 
alarm  figure  is  apparently  possible  with  some  filter  manipulations. 


Figure  9.  Virtual  Centers.  Expansion  of  correlation  plane 
center.  Dashed  lines  enclose  center  40^  (•  1600) 
pixels.  Numbers  represent  input  orientation 
yielding  the  virtual  center.  (DEGREES) 

* 
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6 .  FUTURE  WORK 


The  work  performed  in  this  contract  has  given  us  a  reasonable 
understanding  of  the  experimental  performance  of  the  GMF.  Some  advantages  and 
disadvantages  have  been  pointed  out,  and  the  feasibility  of  frequency-plane 
averaging  for  rotation  tolerance  has  been  thoroughly  demonstrated.  One 
specific  algorithm  improvement  has  been  proven  necessary.  It  is  described 
below. 


6.1  Use  of  Complex  Numbers 

The  generalized  matched  filter  (GMF)  algorithm  transforms  the  2D  array  of 
complex  expected  values  and  variances  into  a  ID  signal  for  subsequent 
processing  to  find  an  "optimum  linear  discriminant."  The  optimum  linear 
discriminant  (a  ID  signal)  is  then  inverse  transformed  to  a  2D  array  of 
complex  values  which  constitutes  the  GMF.  Professor  William  T.  Rhodes  made  an 
Insightful  remark  on  this  process:  "You  are  free  to  use  any  2D  to  ID 
transformation."  Let  us  expand  on  that  remark. 

In  deriving  the  GMFs  for  this  report,  we  represented  the  complex  number 

n  ■  x  +  iy  *  A  exp  (10)  (24) 

by  the  two  numbers  x  and  y.  This  gives  equal  Importance  to  the  real  Imaginary 
parts.  This  seems  sensible.  Analysis  by  Horner8  suggests  that  0  is  much  more 
Important  than  A  in  pattern  recognition.  This  suggests  two  other  approaches 
which  should  lead  to  Improved  GMFs: 

o  Use  A  and  0  rather  than  x  and  y  or 

o  Use  0  only. 
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The  former  gives  a  nonlinear  emphasis  on  0.  The  latter  gives  a  phase  only 
GMF.  In  addition  to  this  clear  improvement  in  the  GMF  algorithm,  future  work 
should  concentrate  on  actual  production  of  optical  Fourier-plane  phase-only 
filters.  These  will  probably  best  take  the  form  of  on-axis  klnoforms  encoded 
by  computer  to  properly  phase  mask  the  spatial  frequency  content  of  the 
spatial  information  input  to  a  target  identification  optical  computer. 
Aerodyne  Research,  Inc.  (ARI)  has  designed  a  method  for  making  such  phase 
masks  using  bleached  photographic  plates  or  film.  Binary  phase 
representations  based  on  0,  *  phases  only  can  also  be  generated  in  this 
manner. 

6.2  Phase  Only  GMFs 

We  believe  that  the  phase-inf ormatlon-enhanced  phase  only  MFs  and  GMFs 
(based  on  the  analysis  of  Subsection  6.1)  represent  a  very  significant 
direction  for  future  development. 
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